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Abstract — Publish-subscribe-based  Information  Management 
(IM)  services  provide  a  key  enabling  technology  for  net-centric 
operations.  This  paper  describes  technology  for  Quality  of  Ser¬ 
vice  (QoS)  and  Internet-Pro tocol-based  Airborne  Networking 
features  for  IM  services.  Enhancing  IM  services  with  airborne 
networking  features  improves  effectiveness  in  combined  tactical 
and  enterprise  networks  with  mobile  airborne  and  ground-based 
embedded  platforms  interacting  with  enterprise  systems  in  com¬ 
mand  and  control  operations. 
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I.  Introduction 

Information  Management  (IM)  services  provide  key  tech¬ 
nology  for  net-centric  operations  by  enabling  the  active  discov¬ 
ery,  management,  and  dissemination  of  information  based  on 
content  and  metadata,  through  a  publish/subscribe/query  para¬ 
digm  that  decouples  information  producers  and  consumers.  IM 
services  in  mission- critical  systems  must  include  the  capability 
to  specify  and  enforce  Quality  of  Service  (QoS)  requirements 
for  information  objects,  which  must  be  satisfied  under  the  con¬ 
straints  of  the  available  communications  and  computational 
resources. 

In  contrast,  Network  Management  (NM)  refers  to  the  moni¬ 
toring  and  control  of  networking  parameters  to  ensure  message 
delivery  properties  are  within  cost  and  capacity  constraints. 
NM  is  information  agnostic;  focuses  on  lower-level  metrics 
and  operates  at  the  physical,  data  link,  network  and  transport 
layers;  and  is  generally  designed  and  optimized  for  specific 
types  of  networks  and  topologies. 

The  increasing  interconnectivity,  complexity,  and  heteroge¬ 
neity  of  deployed  communication  systems  and  the  combination 
of  enterprise  and  tactical  networks  provide  challenges  for  effec¬ 
tive  network  and  QoS  management  for  multiple  users  and  po¬ 
tentially  competing  missions.  Enterprise  networks  typically  run 
Internet  or  intranet  protocols,  relying  on  high  bandwidth  and 
relatively  stable  communication  links  and  Internet  Protocol 
(IP)-based  communication.  In  contrast,  tactical  networks  fre¬ 
quently  service  mobile  nodes  running  Mobile  Ad  hoc  Network 


(MANET)  communication  protocols,  and  have  both  con¬ 
strained  and  dynamic  network  conditions. 

In  this  paper  we  introduce  an  integrated  information  and 
network  management  approach  for  QoS  support  in  mixed  tacti¬ 
cal  and  enterprise  networks  consisting  of  mobile  nodes  with  ad 
hoc  communication  moving  between  terrestrial  networks  utiliz¬ 
ing  traditional  IP-based  protocols.  In  these  environments,  QoS 
features  common  in  enterprise  networks,  such  as  Differentiated 
Services  (DiffServ)  [2],  do  not  readily  translate  to  IM  service- 
level  QoS  in  tactical  networks  due  to  the  high  potential  for  los¬ 
sy,  noisy,  and  intermittent  links.  For  example,  the  loss  of  only  a 
single  packet  at  the  network  layer  might  statistically  be  consid¬ 
ered  high  QoS,  but  might  prevent  a  message  from  being  recon¬ 
structed  at  the  IM  service-level,  rendering  the  other  packets 
delivered  for  that  message  useless. 

Our  approach  builds  upon  previous  work  in  QoS  manage¬ 
ment  for  IM  services  under  the  QoS  Enabled  Dissemination 
(QED)  project  [10]  and  a  cross-layer  communication  substrate 
[3]  that  provides  airborne  networking  capabilities  for  address¬ 
ing  of  mobile  nodes,  bandwidth  and  bottleneck  awareness,  and 
prioritization  of  information  at  the  application-  and  packet- 
level. 

In  this  paper  we  present  our  design  and  implementation  of 
QoS  management  for  airborne  networks,  a  prototype  imple¬ 
mentation  for  a  US  Air  Force-developed  set  of  IM  services  [7], 
and  a  corresponding  demonstration  and  experimentation  re¬ 
sults. 

II.  Features  of  Airborne  Networks 

Airborne  Networks  (ANs)  are  characterized  as  a  combina¬ 
tion  of  fixed  and  ad  hoc  network  components.  Airborne  plat¬ 
forms  communicate  through  wireless  links  to  one  another  gen¬ 
erally  using  ad  hoc  protocols,  and  to  nodes  in  terrestrial  net¬ 
works  generally  using  static  routes,  or  infrastructure-based 
routing  protocols,  as  shown  in  Figure  1. 

The  scenario  illustrated  in  Figure  1  requires  a  number  of 
key  capabilities  that  include  addressing  of  mobile  nodes  as  they 
migrate  between  networks,  prioritized  data  delivery,  link  ca¬ 
pacity  estimation,  and  bandwidth  management  on  shared  wire¬ 
less  links.  We  discuss  each  of  these  in  turn. 
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Figure  1.  Interpretation  of  an  airborne  network. 


A.  Mobile  IP 

Mobile  IP  [13]  enables  aerial  nodes  to  seamlessly  transition 
between  ground  networks  and  continue  communicating,  with¬ 
out  the  need  for  explicit  reconfiguration  -  a  key  capability  for 
airborne  networks.  Mobile  IP  allows  mobile  nodes  to  maintain 
their  IP  addresses  when  moving  across  separate  networks. 
Hence,  ongoing  sessions  (e.g.,  TCP  streams)  can  be  maintained 
during  network  migrations. 

B.  Differentiated  Services 

The  purpose  of  Differentiated  Services  (DiffServ)  is  to  al¬ 
locate  bandwidth  through  prioritized  treatment  of  various  clas¬ 
ses  of  traffic.  A  Weighted  Fair  Queuing  (WFQ)  approach  to 
DiffServ  ensures  that  each  traffic  flow  has  fair  access  to  net¬ 
work  resources,  i.e.,  no  traffic  flows  are  capable  of  starving 
other  flows  and  bursty  flows  are  prevented  from  consuming 
more  than  their  share  of  bandwidth.  WFQ,  however,  does  not 
allocate  dedicated  amounts  of  bandwidth  per-priority,  as  this 
would  result  in  sub-optimal  use  of  the  network.  Instead,  if 
bandwidth  is  available,  it  is  consumed  by  the  highest  priority 
traffic  available  at  the  time-of-send.  DiffServ  can  be  provided 
at  multiple  OSI  layers  (e.g.,  application  layer,  network  layer, 
etc.). 

C.  Bandwidth  Estimation  and  Bottleneck  Detection 

QoS  management  is  facilitated  by  an  accurate  estimation  of 
the  capacity  of  the  network.  This  is  especially  useful  to  deter¬ 
mine  how  much  information  of  various  priorities  the  available 
network  capacity  can  support.  Otherwise,  it  is  possible  for  an 
IM  layer  to  introduce  more  high  priority  information  into  the 
network  than  it  can  support,  resulting  in  the  network  level 
dropping  or  in  the  delay  of  individual  packets,  each  of  which 
can  prevent  the  reconstruction  of  an  important  message. 

Accurate  bandwidth  estimation  has  been  difficult  to  do  reli¬ 
ably  in  practice.  Fixed  terrestrial  networks  have  been  able  to 
rely  on  theoretical  capacities  -  reliable  because  of  the  fixed 
nature  of  the  network.  In  contrast,  ANs  have  network  capacities 
that  vary  significantly  due  to  distance,  noise,  and  other  factors, 
rendering  any  theoretical  capacities  of  the  network  unreliable. 

A  useful  approximation  is  afforded  by  bottleneck  detection. 
Since  an  AN  is  made  up  of  a  network  of  individual  platform  to 
platform  links,  detecting  a  particular  link  that  has  become  a 


bottleneck  (i.e.,  more  traffic  has  arrived  at  the  link  than  the  link 
can  transmit  at  any  given  time)  allows  QoS  management  to 
reduce  the  load  caused  by  messages  traversing  that  link,  even  if 
the  actual  capacity  of  the  network  is  unknown. 

D.  Explicit  Channel  Reservation 

Explicit  Channel  Reservation  (ECR)  provides  guaranteed 
bandwidth  for  a  stream  of  important  packets.  ECR  works  by 
establishing  reservations  for  a  stream  of  traffic.  Although 
DiffServ  is  more  prevalent,  protocols  like  the  ReSerVation 
Protocol  (RSVP)  [17]  are  still  used  occasionally  for  important 
message  delivery  or  applications  with  streaming  data. 

E.  Concurrent  Multipath  Routing 

The  purpose  of  Concurrent  Multipath  Routing  (CMR)  is  to 
increase  network  utilization  by  exploiting  multiple  network 
paths  between  nodes.  CMR  can  be  used  to  increase  bandwidth 
between  nodes  and/or  balance  load  by  routing  packets  over 
different  network  paths.  CMR  can  also  be  used  for  fault  toler¬ 
ance  by  providing  redundant  paths  for  network  packets. 

III.  Implementing  AN  Features  In  The  VIA 
Communications  Substrate 

VIA  is  a  next  generation  cross-layer  communications  sub¬ 
strate  [3]  for  tactical  networks  and  IM  systems.  VIA  enables 
applications  to  adapt  and  leverage  the  characteristics  of  the 
dynamic  communication  environment  and  enables  the  underly¬ 
ing  communications  infrastructure  to  better  support  application 
QoS  requirements  and  constraints. 

As  shown  in  Figure  2,  VIA  operates  below  the  network  lay¬ 
er,  which  allows  it  to  transparently  manage  protocol  packets 
such  as  ARP  and  IP,  including  ICMP,  TCP  and  UDP.  VIA 
does  not  require  encapsulation  and  control  information  is  in¬ 
serted  into  IP  packets,  e.g.,  using  the  IP  Options  field.  Thus, 
existing  applications  can  take  advantage  of  VIA  without  any 
modifications  and  non- VI A  and  VIA  nodes  can  interoperate. 


Figure  2.  Conceptual  view  of  the  VIA  architecture. 

Applications  that  bind  to  VIA’s  virtual  network  interface 
(i.e.,  viaO)  can  transparently  make  use  of  VIA  capabilities  to 
support  communication  and  QoS  requirements.  Outgoing  pack¬ 
ets  are  intercepted,  processed,  and  sent  over  one  or  more  physi¬ 
cal  interfaces  operating  in  promiscuous  mode.  Conversely, 
incoming  packets  are  captured,  processed,  and  injected  into  the 
virtual  network  interface,  emulating  a  physical  link  between  the 
two  end-points. 


Additional  features  that  extend  existing  VIA  capabilities  are 
implemented  as  modules.  Based  on  the  capabilities  described  in 
Section  II,  we  identified  a  set  of  capabilities  to  be  created  as 
VIA  modules  to  support  AN  features.  Each  of  these  imple¬ 
mented  modules,  including  Mobile  IP,  Bottleneck  Detection, 
Differentiated  Services,  and  Capacity  Estimation  are  described 
in  this  section. 

A.  Mobile  IP 

As  discussed  in  the  previous  sections,  Mobile  IP  allows 
mobile  nodes  to  maintain  their  IP  addresses  when  moving 
across  separate  networks,  maintaining  active  streams  during 
network  migrations.  Assuming  that  at  least  one  node  in  each 
network  can  communicate  with  one  another  using  normal  IP 
routing  mechanisms,  transparent  migration  of  mobile  nodes  can 
be  achieved  using  a  combination  of  ad  hoc  routing  and  trans¬ 
parent  packet  tunneling. 

Consequently,  VIA  implements  an  ad  hoc  based  approach 
to  Mobile  IP  that  provides  a  mechanism  to  propagate  ad  hoc 
routes  across  the  mobile  node's  home  and  foreign  networks1,  as 
well  as  the  ability  to  automatically  establish  a  Generic  Routing 
Encapsulation  (GRE)  tunnel  between  two  gateway  nodes  that 
transparently  forwards  traffic  from  the  home  to  the  foreign 
network  and  vice-versa.  Upon  joining  a  foreign  network,  mo¬ 
bile  nodes  register  themselves  with  the  gateway  node  (Figure 
3).  When  the  mobile  node  migrates  to  a  foreign  network  (1),  it 
registers  with  the  foreign  gateway  node  (2),  which  exchanges 
registration  information  with  the  mobile  node's  home  gateway 
node  to  create  and  maintain  the  GRE  tunnel  (3)  for  enabling  the 
propagation  of  packets.  After  migration,  VIA-enabled  nodes  in 
the  home  and  foreign  networks  automatically  update  the  routes 
to  the  mobile  node  and  communicate  through  the  GRE  tunnel 
transparently. 


Figure  3.  A  mobile  node  migrates  from  its  home  network  to  a  foreign  network. 
B.  Bottleneck  Detection 

Communication  paths  between  nodes  in  airborne  and  terres¬ 
trial  networks  consist  of  shared  bandwidth  links,  as  well  as 
links  with  different  (possibly  dynamic)  bandwidth  capacities 
that  could  result  in  bottlenecks  when  transmitting  data  at  high 
rates.  Moreover,  intermediate  nodes  have  different  resource 


The  home  network  is  the  network  from  which  the  mobile  node’s 
persistent  IP  address  is  derived.  A  foreign  network  is  any  network 
into  which  the  mobile  node  moves. 


constraints  that  may  limit  the  speed  at  which  packets  can  be 
forwarded  at  each  hop,  causing  delays  that  result  in  communi¬ 
cation  bottlenecks.  To  detect  a  link  bottleneck,  VIA  keeps  track 
of  the  number  of  bytes  transmitted  (TX  rate)  and  received  (RX 
rate)  for  all  frames,  and  periodically  reports  back  to  the  up¬ 
stream  node  the  actual  RX  rate.  Each  upstream  node  compares 
the  RX  rate  reported  by  the  downstream  node  to  the  actual  TX 
rate,  and  if  the  difference  between  rates  is  greater  than  a  certain 
threshold,  VIA  emits  a  bottleneck  notification  (Figure  4).  Since 
the  goal  is  to  provide  IM  service-level  QoS  on  an  end-to-end 
basis,  the  notification  specifies  the  IP  addresses  of  the  affected 
destinations2,  rather  than  the  next  hop  IP  information,  and  an 
estimate  of  the  capacity  through  the  bottleneck. 


Figure  4.  Node  N2  detects  a  bottleneck  and  reports  it  back  to  node  Nl. 


In  addition,  VIA  periodically  monitors  the  size  of  the 
transmission  queue(s).  If  the  size  of  the  queue(s)  is  larger  than 
a  certain  threshold,  VIA  emits  a  bottleneck  notification.  In  con¬ 
trast  to  what  occurs  when  a  link  bottleneck  is  detected,  the  ad¬ 
dresses  of  the  affected  destinations  are  determined  by  inspect¬ 
ing  the  IP  header  of  each  of  the  packets  waiting  in  the  queue. 

C.  Differentiated  Services 

VIA  provides  support  for  differentiated  services  using  a 
WFQ  approach.  A  module  classifies  packets  into  eight  (0-7) 
distinct  traffic  classes  based  on  the  type  of  traffic  and,  in  the 
case  of  IP  datagrams,  on  the  value  of  the  Differentiated  Service 
Code  Point  (DSCP)  field  of  the  packet's  IP  header.  Each  traffic 
class  has  a  corresponding  queue  with  a  pre-configured  weight 
that  allows  the  module  to  prioritize  the  transmission  of  packets 
and  guarantee  a  minimum  bandwidth  allocation  for  each  traffic 
class.  With  the  goal  of  maintaining  network  connectivity  at  all 
times  when  possible,  the  module  automatically  classifies  pack¬ 
ets  from  certain  protocol  types  such  as  ARP  and  other  network 
management  traffic,  including  VIA  control  messages,  as  traffic 
class  7,  which  has  the  highest  priority  (i.e.,  traffic  from  this 
class  is  always  sent  ahead  of  any  other  type  of  traffic). 

D.  Capacity  Estimation 

QoS  features,  such  as  bandwidth  reservation  and  rate  adap¬ 
tation,  require  knowledge  of  available  link  capacity  to  effec¬ 
tively  manage  the  utilization  of  the  link.  A  naive  method  for 
capacity  estimation  consists  of  saturating  the  link  by  sending 
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The  addresses  of  the  affected  destinations  are  determined  by  in¬ 
specting  the  IP  header  of  each  packet  that  traverses  the  node. 


artificial  traffic  at  an  increasing  transmission  rate,  until  packet 
loss  is  detected  at  the  application  layer.  The  main  drawback 
with  this  approach  is  the  disruption  of  application  traffic  that 
occurs  when  the  link  is  operating  over  capacity. 

VIA  utilizes  an  approach  for  on-demand  capacity  estima¬ 
tion  in  wireless  links  with  Media  Access  Control  (MAC)  that 
also  relies  on  sending  artificial  traffic  to  saturate  the  link  but 
introduces  little  to  no  disruption  to  the  application  traffic.  It 
relies  on  adverse  link  conditions  being  manifested  at  the  MAC 
layer  before  they  affect  the  behavior  of  application  traffic.  VIA 
monitors  the  size  of  the  MAC  transmission  queue  to  determine 
the  saturation  point  of  the  link,  looking  for  the  queue  to  grow 
above  a  certain  threshold  before  packet  loss  would  be  detected 
at  the  application  layer.  Specifically,  VIA  monitors  the  number 
of  frames  queued  by  the  MAC  layer,  and  in  parallel  introduces 
artificial  traffic  at  a  low  transmission  rate.  While  the  number  of 
MAC  frames  waiting  to  be  transmitted  is  below  a  certain 
threshold,  VIA  increases  the  transmission  rate  of  artificial  traf¬ 
fic.  The  remaining  link  capacity  is  assumed  to  be  the  reported 
transmission  rate  just  before  the  size  of  the  queue  reaches  the 
threshold,  and  at  which  VIA  stops  the  transmission  of  artificial 
traffic.  By  detecting  the  queue  growth  at  the  MAC  layer,  VIA 
is  able  to  compute  the  capacity  without  packet  loss  at  the  appli¬ 
cation  layer. 


IV.  Integrated  Information  QoS  Support 

While  QoS  management  in  the  airborne  network  is  a  neces¬ 
sary  feature  for  control  and  visualization,  it  is  not  sufficient  to 
achieve  aggregate  QoS  control  across  a  mission  or  to  enforce 
higher-level  client  or  information-level  policies,  such  as  treat¬ 
ing  all  packets  of  an  information  object  uniformly,  enforcing 
deadlines,  replacing  stale  information,  or  changing  format  to  fit 
client  needs  or  available  bandwidth.  What  is  needed  is  monitor¬ 
ing  and  control  of  the  underlying  communications  architecture 
by  a  higher  level  QoS  manager,  as  shown  in  Figure  5. 
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schedules  CPU  intensive  tasks.  These  local  QoS  managers  (lo¬ 
cal  because  they  manage  QoS  at  a  single  control  point)  are  un¬ 
der  the  control  of  an  Aggregate  QoS  Manager  that  stores,  se¬ 
lects,  and  distributes  policies  to  achieve  end-to-end,  consistent 
QoS  for  multiple  publish-subscribe  information  flows. 

We  have  previously  described  QED’s  architecture,  proto¬ 
type  implementation,  and  mechanisms  and  services  [9],  [10],  as 
well  as  its  use  in  embedded  US  Air  Force,  Marine,  and  Navy 
exercises  [6],  [12].  To  provide  QoS  in  IM  systems,  the  QED 
prototype,  shown  in  Figure  6,  performs  the  following: 

•  Manages  the  scheduling  of  threads  and  bandwidth  typical¬ 
ly  hidden  behind  service  interfaces. 

•  Provides  and  enforces  QoS  policy  specified  at  a  high  level, 
based  on  user,  information,  and  system  concepts. 

•  Provides  policy-driven  aggregate  QoS  management  across 
control  points  and  across  users,  despite  the  publishing  and 
consuming  clients  being  decoupled  from  one  another. 

•  Handles  information  that  varies  in  size  and  processing  that 
varies  in  time. 
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Figure  6.  QED  provides  QoS  management  for  IM  Services. 


QED  prioritizes  information  objects  based  on  high-level 
mission  policies,  enforces  deadlines,  and  replaces  old  infor¬ 
mation  objects.  It  utilizes  VIA’s  AN  features  to  maintain,  pub¬ 
lish  and  subscribe  connections  to  mobile  clients.  QED  receives 
bottleneck  notifications  from  VIA  and  throttles  the  rate  of  in¬ 
formation  to  match  the  reported  capacity  to  clients  sharing  bot¬ 
tleneck  links. 


Figure  5.  Achieving  mission-based  QoS  requires  management  and  control  at 
the  application  and  networking  layers. 

To  prototype  an  integrated  system  for  IM  service-level  QoS 
management  in  ANs,  we  have  integrated  our  QED  services  [9], 
[10]  with  the  AN  features  provided  by  VIA.  QED  provides  a 
set  of  policy-driven  QoS  managers  and  mechanisms  that  ensure 
the  timely  and  smooth  brokering  and  dissemination  of  im¬ 
portant  information  through  IM  services,  gracefully  degrade 
when  resources  are  overloaded,  and  enforce  client  preferences 
and  priorities.  QED  includes  a  Dissemination  Service  that  per¬ 
forms  prioritization  of  information  delivery,  bandwidth  man¬ 
agement,  and  information  shaping,  and  a  Task  Manager  that 


V.  Experimental  Results 

We  ran  experiments  to  determine  the  effectiveness  of  Mo¬ 
bile  IP  and  Bottleneck  Detection  in  airborne  networks.  All 
experiments  were  run  with  VIA  and  QED. 

A.  Mobile  IP  Experiment 

The  goal  for  the  Mobile  IP  experiment  is  to  determine  the 
amount  of  time  required  for  an  airborne  mobile  subscriber  to 
reconnect  to  a  terrestrial  network  after  a  Mobile  IP  migration 
and  resume  receipt  of  Information  Objects  (10 s)  from  the  IM 
services  (without  re- sub  scribing).  To  measure  this  value,  we 
perform  the  following  steps:  a)  Publish  constant- size  10 s  at  a 


rate  that  does  not  exceed  network  capacity,  b)  Trigger  a  mobile 
IP  migration  by  disconnecting  the  mobile  subscriber  from  one 
airborne  network  and  connecting  it  to  the  other  airborne  net¬ 
work,  and  c)  Measure  the  time  between  the  last  10  seen  before 
the  migration  and  the  first  10  seen  after  the  migration. 

B.  Mobile  IP  Results 

The  results  of  the  Mobile  IP  experiment  are  shown  in  Table  1. 
The  results  represent  thirty  (30)  iterations  of  the  mobile  IP  ex¬ 
periment  in  each  direction  of  migration. 


QED  tries  to  send  high-priority  traffic  first,  but  when  the 
link  capacity  is  unknown,  it  cannot  properly  prioritize  the  traf¬ 
fic.  This  fact  explains  the  discrepancy  between  the  “High- 
Priority  (With  Mgmt)”  and  “High-Priority  (No  Mgmt).”  The 
lack  of  link  capacity  knowledge  causes  inconsistency  in  priori¬ 
tization  and  can  even  result  in  priority  inversion  (as  seen  at  the 
beginning  of  the  experiment).  The  reason  this  occurs  is  that 
once  the  application-layer  sends  an  10  to  the  transport  layer,  it 
can  no  longer  control  its  outbound  priority.  It  becomes  just 
another  set  of  packets  in  the  interface’s  egress  buffer. 


Table  1.  Mean  and  standard  deviation  of  reconnection  times  after  a  mobile  IP 
migration  in  each  migration  direction. 


Reconnection  Time  (sec) 

Migration  Direction 

Mean 

<7 

Foreign  to  Home 

2.3 

1.9 

Home  to  Foreign 

9.0 

4.0 

Our  first  finding  was  that  the  reconnection  time  after  a  Mo¬ 
bile  IP  migration  depends  on  the  direction  of  the  migration. 
Migrating  from  the  home  network  to  a  foreign  network  is  sig¬ 
nificantly  slower  because  of  the  overhead  associated  with  creat¬ 
ing  a  tunnel  between  the  two  networks.  The  tunnel  is  not  re¬ 
quired  for  communicating  within  the  home  network,  so  the 
reconnection  time  when  migrating  back  to  the  home  network  is 
significantly  faster. 

We  also  found  that  VIA  was  able  to  handle  mobile  IP  mi¬ 
gration  fast  enough  that  there  was  often  no  noticeable  disturb¬ 
ance  to  the  application-layer.  Migrations,  however,  can  cause 
noticeable  network  delays,  and  thus  can  cause  problems  in  ap¬ 
plications  that  are  not  tolerant  to  network  disruptions. 

C.  Bottleneck  Management  Experiment 

The  goal  of  the  bottleneck  management  experiment  is  to  de¬ 
termine  the  effect  of  bottleneck  management  on  prioritized  IOs 
in  a  bottleneck-constrained  network  from  the  point-of-view  of 
the  information  subscriber.  The  metric  we  use  to  measure  bot¬ 
tleneck  management's  performance  is  end-to-end  10  latency. 
To  measure  this  value,  we  performed  the  following  steps: 

•  Publish  IOs  at  a  rate  that  exceeds  network  link  capacity  to 
the  subscriber,  but  does  not  exceed  the  network  link  ca¬ 
pacity  from  any  publisher. 

•  Measure  the  time  elapsed  from  the  creation  of  the  10  by 
its  producer  (the  publisher)  to  the  time  it  is  received  by  its 
consumer  (the  subscriber). 

D.  Bottleneck  Management  Results 

The  results  of  the  bottleneck  management  experiment  are 
shown  in  Figure  7.  These  results  represent  two  iterations  of  the 
bottleneck  management  experiment  -  one  with  bottleneck 
management  enabled  (“With  Mgmt”),  and  one  with  bottleneck 
management  disabled  (“No  Mgmt”).  The  results  show  that, 
with  bottleneck  management  enabled,  high-priority  traffic  is 
strictly  preferred  over  low-priority.  It  also  shows  that  low- 
priority  traffic  does  not  pay  a  significant  penalty  for  operating 
with  bottleneck  management. 
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Figure  7.  End-to-end  latency  of  high/low  priority  IOs  with  bottleneck  man¬ 
agement  enabled  versus  disabled. 

Another  problem  we  encountered  occurs  when  probing  for 
an  increase  in  link  capacity.  At  this  point,  TCP  slow-start  was 
throttling  traffic  at  the  transport  layer  before  VIA  could  detect 
the  bottleneck.  To  resolve  this  issue,  we  replaced  the  TCP  con¬ 
gestion  control  algorithm  with  one  that  does  not  slow-start. 
Another  solution  to  the  problem  would  be  to  use  a  transport 
that  does  not  perform  congestion  control  (e.g.,  UDP). 

VI.  Related  Work 

While  there  has  not  been  a  lot  of  work  on  combined  infor¬ 
mation  and  network  management  approaches  for  airborne  net¬ 
work  environments,  there  has  been  previous  independent  re¬ 
search  in  each  of  publish- sub  scribe  Information  Management 
and  Network  Management. 

The  primary  information  management  research  that  we 
build  upon  is  based  on  the  Joint  Battlespace  Infosphere  concept 
[14],  [15],  which  has  been  realized  in  several  prototype  ver¬ 
sions  [4],  [7],  [8],  [16].  A  number  of  other  publish-subscribe 
services  are  available,  although  most  only  provide  an  interface 
for  disseminating  information,  rather  than  the  rich,  active  in¬ 
formation  management  of  the  IM  services.  Eugster  et  al.  pro¬ 
vide  an  overview  of  the  pub-sub  interaction  pattern,  highlight¬ 
ing  the  decoupled  nature  of  publishers  and  subscribers  in  time, 
space,  and  synchronization  [5].  A  few  researchers  have  investi¬ 
gated  QoS  management  in  pub- sub  middleware.  Mahambre  et 
al  present  a  taxonomy  of  pub-sub  middleware  with  QoS  fea¬ 
tures,  acknowledging  significant  gaps  in  the  provision  of  QoS 
features  to  the  extent  that  some  environments  need  [11]. 

The  Joint  Capability  for  Airborne  Networking  (JCAN)  [1] 
is  a  multi-layer  infrastructure  for  airborne  network  communica¬ 
tions  that  provides  different  features  at  the  data-link,  network 
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and  transport  layers.  It  also  includes  application  layer  libraries 
for  interacting  with  the  lower-layer  features  of  JCAN.  JCAN 
provides  implementations  for  Mobile  IP,  ECR  WFQ,  and 
CMR. 

The  key  difference  in  JCAN’s  implementation  of  Mobile  IP 
is  the  mechanism  JCAN  uses  for  intercepting  all  the  network 
traffic  destined  for  the  mobile  nodes,  called  Proxy  ARP.  With 
Proxy  ARP,  the  gateway  on  the  home  network  responds  to 
ARP  requests  made  for  any  mobile  nodes,  and  forwards  the 
intercepted  traffic  over  an  IP  tunnel. 

JCAN’s  implementation  of  ECR  has  several  components. 
One  component  is  an  application  layer  interface  to  link  reserva¬ 
tion.  Another  component  is  a  replacement  C  library  for  Unix 
sockets,  called  g Socket,  for  rate  control.  This  socket  library  has 
the  same  structure  as  the  Unix  socket  library  for  easy  replace¬ 
ment  in  source  code,  however,  every  program  that  wants  to 
make  use  of  gSockets  must  be  recompiled.  Another  shortcom¬ 
ing  of  JCAN’s  ECR  implementation  is  that  a  multi-hop  link 
must  be  fully  reserved  before  any  data  is  transferred.  Similarly, 
reservations  hinder  network  utilization  by  preventing  traffic 
flows  from  using  a  currently  under-utilized  link.  For  these  rea¬ 
sons,  differentiated  services  have  been  used  more  frequently. 

JCAN’s  WFQ  module  uses  an  Active  Timed  Queue  (ATQ) 
Linux  kernel  module,  a  replacement  to  the  normal  outgoing 
packet  scheduler.  The  ATQ  scheduler  is  the  component  that 
prevents  traffic  flows  from  starving  each  other  of  bandwidth. 
The  downside  of  using  the  ATQ  module,  as  opposed  to  some¬ 
thing  that  provides  “strict”  priority,  is  that  the  ATQ  scheduler 
relies  on  accurate  link  capacity  estimation,  which  is  not  availa¬ 
ble  in  JCAN. 

JCAN  implements  CMR  using  the  iproute2  suite  to  manip¬ 
ulate  IP-layer  routing.  The  ip  route  command  allows  multiple 
nexthop  arguments,  which  specify  the  alternatives  for  egress 
routes.  JCAN’s  implementation  of  CMR  uses  the  Linux  kernel 
equalize  patch,  which  allows  transport-layer  flows  (e.g.,  TCP 
streams)  to  be  split  among  multiple  egress  routes.  However,  the 
equalize  kernel  patch  has  been  deprecated  since  the  develop¬ 
ment  of  the  JCAN  framework,  and  therefore,  we  were  unable 
to  get  the  patch  to  work  (despite  using  a  JCAN-prescribed  ver¬ 
sion  of  Linux).  Furthermore,  the  Linux  Advanced  Networking 
community  recommends  against  using  the  patch  for  various 
reasons,  but  mostly  because  it  prevents  optimizations  that  im¬ 
prove  the  performance  of  some  transport  protocols. 

VII.  Conclusions 

Our  initial  prototype  of  Airborne  Networking  features  and 
integration  with  IM  and  QoS  management  services  has  shown 
promise  in  enabling  greater  levels  of  predictability,  control,  and 
performance  for  net-centric  information  exchange  with  mobile 
platforms  and  heterogeneous  wireless  and  wired  networks.  Our 
approach  goes  beyond  previous  approaches  in  supporting  (1)  a 
combination  of  ad  hoc  and  IP-based  routing  which  supports 
faster  routing  to  locally-discoverable  nodes  and  (2)  QoS  man¬ 
agement  for  information  objects,  which  provides  better  mis¬ 
sion-oriented  quality  while  achieving  high  levels  of  network 
utilization. 

The  research  and  prototype  software  that  we  describe  estab¬ 
lishes  a  basis  upon  which  to  build  for  more  complete  AN  and 
QoS  features  in  heterogeneous  operations  at  large  scale.  Future 


work  includes  establishing  more  of  the  AN  features  such  as 
ECR  and  CMR,  addressing  inconsistencies  between  IP-based 
and  tactical  networks,  and  evaluating  the  capabilities  at  larger 
scale  and  in  embedded,  tactical  platforms. 
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